perm filename CHAP9[4,KMC]2 blob sn#020517 filedate 1973-01-15 generic text, type T, neo UTF8
00100		CHAPTER 9
00200	
00300	   MODEL EVALUATION
00400	
00500		An  evaluation procedure for a model involves the disarmingly simple
00600	question - `is it a good model?' The ordinary language term `good'
00700	means praiseworthy. But what is a model good at or good for in order to
00800	be praiseworthy? It depends on how well it serves the purposes for which it was constructed.
00900	Our primary aim in constructing this model was to explore and test a theory having explanatory verisimilitude.
00910	To satisfy this aim the model must meet norms of internal consistency
00920	and norms of external correspondence with observed phenomena. A secondary
00930	aim involved pragmatic norms.
01200		A model in the form of an algorithm consists of a structure of
01300	mechanisms whose inner workings are sufficient to generate the outward
01400	behavior under consideration. The theory embodied in the model is
01500	revealed by the set of statements which describes how the structure
01600	reacts under various circumstances.
01700		Theories have many functions. They can be summarized as follows
01800	[from Bunge?]
01900		(1)To systematize knowledge.
02000		(2)To explain facts by showing how they are the entailed
02100	              consequences of the systematizing hypotheses.
02200		(3)To increase knowledge by deriving new facts.
02300		(4)To enhance the testability of hypotheses by connecting them to observations.
02400		(5)To guide research by:
02500	              (a)posing fruitful problems
02600	              (b)suggesting new data to gather
02700	              (c)opening new lines of investigation
02800		(6)To map a portion of reality.
02900		It is a tall order for a theory to fulfill all of these
03000	functions. In undeveloped fields we should be happy with even one
03100	of them. Models can be assigned  these functions when they are
03200	theoretical, rather than replicative, in type. Our model was intended
03300	primarily to serve functions (2) and (4), testable explanation.
03400		What constitutes a satisfactory explanation has been treated in
03500	section 00.0. The `fit' with phenomena as indicated by some measurement
03600	or empirical test indictes truth, verisimilitude, or grains of truth.
03700	Our tests and measures were described in section 000.0. Acceptability of
03800	a model sometimes depends not so much on truthlikehood, an elusive state,
03900	as on whether a majority of the relevant expert community believes
04000	the theory or model to approximate truth to some unknown and unknowable
04100	degree. Truth or falsity cannot be proven with certainty but their
04200	presence can be assayed bt critical assesment and deliberation. A theory
04300	or model may bring cognitive or pragmatic comfort, not because it is TRUTH
04400	but because it represents an improvement or its explanatory rivals. Cognitive
04500	comfort is a type of intellectual satisfaction while pragmatic comfort
04600	accrues from applications to  problems in order to make things work the
04700	way humans want them to work.
04800		It would be a bonus if our model could satisfy those interested
04900	in function(3) listed above, making possible new knowledge through prediction.
05000	This novelty could arise in two ways. First the model might demonstrate
05100	a property of the paranoid mode hitherto unobserved clinically.  
05200	In principle this could come about because the I/O behavior of the model
05300	is a consequence of a large number of interacting hypotheses and assumptions
05400	chosen initially chosen to explain frequently observed phenomena. When the
05500	elements of such a complex conjunction interact with input they generate consequences
05600	in addition to those they were designed to explain. Whether any of these
05700	consequences are significant or characteristic of the paranoid mode remains
05800	a subject for future study.
05900		A second source of novelty would lie in the behavior of the model
06000	in some new situation. Since it is designed to simulate communicative
06100	behavior in an interview situation, the `new' circumstance would have to
06200	involve some new type of linguistic interaction which the model is capable
06300	of responding to. From its behavior one might then predict how paranoid
06400	patients would behave under similar circumstances. the requiste
06500	empirical tests and measures would show the degree of correspondence
06600	between patient and model behaviors.
06700		This possibility is of importance in considering therapies for
06800	patients caught in the quandaries of the paranoid mode. Language-based
06900	or semantic techniques do not seem very effective in the psychoses
07000	but they are useful in states of lesser severity. A wide range of
07100	new semantic techniques, including extremes, could be tried first on
07200	the model without hurting patients through blind experimentation.
07300		While we have used the model to explore a theory and to
07400	study psychiatric judgements, its potential use as a training device
07500	has not escaped out attention. Mental health professinals in their
07600	training need `disposable' patients to practice on. A model has the advantage
07700	of not being harmable and providing an opportunity to measure performance.
07800		A theoretical model is evaluated relative to rival explanations.
07900	Our model stands as a contender for the preferred psychological explanation
08000	of paranoid processes. The expert forum will decide its ultimate status.
08100	A theoretical model is partial, perspectival and has a short half-life.
08200	Hopefully it lives long enough to provide a first approximation from
08300	which better approximations can grow.